Quantum Kalman Filtering and the Heisenberg Limit in Atomic Magnetometry 
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The shotnoise detection limit in current high-precision magnetometry [lj is a manifestation of 
quantum fluctuations that scale as in an ensemble of iV atoms. Here, we develop a procedure 

that combines continuous measurement and quantum Kalman filtering to surpass this conven- 
tional limit by exploiting conditional spin-squeezing to achieve 1/N field sensitivity. Our analysis 
demonstrates the importance of optimal estimation for high bandwidth precision magnetometry at 
the Heisenberg limit and also identifies an approximate estimator based on linear regression. 
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Magnetometry is fundamentally a parameter estimation 
process because, like all fields, magnetism cannot be di- 
rectly observed. Rather, the strength of a magnetic field 
must be inferred from its influence on a probe such as 
an atomic spin ensemble 0. In a canonical atomic mag- 
netometer, such an ensemble would be prepared into a 
coherent spin state with its bulk magnetization polar- 
ized along the x-axis, (J(0)) = (J, 0,0) (such as by op- 
tical pumping). Then, a magnetic field along the y-axis 
with magnitude, B, would induce the atomic Bloch vec- 
tor, (J(i)), to precess in the xz-plane with frequency, 
ujl = 7-6. Thus, the magnetic field could be estimated 
from the free induction decay of the atomic magnetiza- 
tion by monitoring the z-component of the Bloch vector, 
(J z (t)) — J exp(— t/Tz) sin^Li), where T2 is the trans- 
verse spin coherence time. 

In practice, current atomic magnetometers operate by 
continuously pumping the atomic sample while a (J z )- 
dependent optical property of the ensemble is monitored 
mtilm Due to pumping, the atoms are constantly re- 
polarized as they Larmor precess. For small fields (the 
relevant case when discussing detection limits), the en- 
semble rapidly achieves an equilibrium that is nearly po- 
larized along the x-axis, but with a steady-state offset, 
(J z ) ss oc jBJ. The uncertainty in measuring J z , is due 
to projection noise @, (AJf) = (J z ) — (J z ) 2 , which has 
a value of J/2 for a coherent spin state. Averaging a se- 
quence of independent measurements of ( J z ) ss with this 
variance leads to the conventional shotnoise detection 
limit for a total measurement time of t to t 0, 0] , 
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Since (Aj, 2 ) sets an intrinsic limit on the field sensi- 
tivity, reducing the projection noise below its standard 
quantum limit would improve the precision. This natu- 
rally leads one to consider spin-squeezed states Q where 
uncertainty in ( J z ) is reduced by redistributing it into the 
orthogonal spin component so that (AJ 2 ) > J/2. Since 

( J y ) does not directly affect the field estimation, spin- 
squeezing should enable one to surpass the conventional 
shotnoise magnetometry limit. 



An improved magnetometry protocol would ideally be 
implemented by utilizing the conditional spin-squeezing 
that is automatically generated by continuous observa- 
tion of an atomic sample H,0>E3 This dynamically gen- 
erated squeezing does not occur in steady-state (narrow- 
band) magnetometers because of the continuous optical 
pumping. However, it should be possible to enable sub- 
shotnoise magnetometry by turning off the optical pump- 
ing once a coherent spin state has been prepared followed 
by continuous observation of the atoms. 

But the nature of conditional spin-squeezing gives rise 
to potential complications that make it initially unclear 
how to exploit the reduced uncertainty for improved mag- 
netometry. Fig. H shows simulated data (generated ac- 
cording to a quantum trajectory model described below) 
of a spin ensemble under continuous measurement with 
no external field, B — 0. As (A j 2 ) decreases [shaded 
region in Fig. [JB)] with the onset of spin-squeezing, 
there is no apparent change in the noise of the associ- 
ated (J z (t)) measurement, y(t) [Fig. UfA)], which is due 
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FIG. 1: (A) Simulatedsingle-shot atomic magnetometry pho- 
tocurrent low pass filtered at F c = 27rvJ/£tot- (B) Corre- 
sponding diffusion of the atomic Bloch vector as conditional 
squeezing is produced by continuous QND observation. 
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to constant optical shotnoise. 

The dynamical generation of spin-squeezing starting 
from an initial coherent state involves a stochastic tran- 
sient at early times. As suggested by the error-ellipse dia- 
grams of Fig.QjB), conditional evolution gradually local- 
izes the quantum spin state around a constant, but ran- 
dom, value of (J z ) c - In an ensemble of continuous mea- 
surement trajectories, this constant value would be dis- 
tributed with a variance of J/2 corresponding to (A J%) 
of the initial coherent state. Therefore, the mean value 
of (J z )c assumes a non-zero value even in the absence 
of an applied magnetic field, producing a stochastic off- 
set in the photocurrent that must be distinguished from 
Larmor precession in a magnetometry experiment. 

Fortunately, with appropriate filtering, Larmor preces- 
sion of the spin state can be distinguished from the pro- 
jection noise in such a way that the field estimation ben- 
efits from spin-squeezing. In this Letter, we demonstrate 
that quantum trajectory theo ry llll Il2j allows one to 
construct a Kalman filter 0,0,13^1 that optimally es- 
timates the field magnitude from continuously observed 
conditional atomic dynamics. This filtering procedure 
enables Heisenberg limited magnetometry despite the op- 
tical shotnoise and the transient effects of spin state es- 
timation. Furthermore, we show that for time-invariant 
fields, our optimal strategy approximately reduces to the 
simple and intuitive data analysis procedure of linear re- 
gression which is a potentially simpler experimental ap- 
proach to sub-shotnoise magnetometry. 

We propose a magnetometer in which the atomic en- 
semble undergoes a continuous quantum non-demolition 
(QND) observation of J z . It has been shown that such 
a measurement can be implemented by detecting J z - 
dependent changes in the phase of an off-resonant cavity 
mode coupled to the atomic ensemble [lflj or by the Fara- 
day rotation of a far-detuned travelling mode jlfllllj that 
passes through the ensemble. In both cases the magne- 
tometer photocurrent is given by, 

y{t) dt = 2r/y/M(j z (t)) c dt + ^dW{t) (2) 

where (J z (t)) c is the conditional expectation value of J z , 
r\ is the detector efficiency and M (in units of frequency) 
is an implementation-dependent constant referred to as 
the measurement strength. The optical shotnoise is re- 
flected by stochastic increments, dW(t), that obey Gaus- 
sian white-noise statistics, J5[dW] = and dW 2 = dt. 

Conditional evolution of the atomic ensemble sub- 
jected to a magnetic field along the y-axis and a QND 
measurement of J z is described by the stochastic master 
equation, 

dp c {t) = -ijB[J ZlPc ]dt + MV[J z ]p c dt (3) 

+ ^M7 1 H[J z }p c dW(t) 

where p c (t) is the reduced atomic density operator con- 
ditioned on the measurement record hj. The super- 
operators, T> and TL, are given by, T>[r]p — rpr^ — (r^rp + 



prV)/2 and 'H[r\p = rp + pr^ — tr[(r + r^)p]p, and the ini- 
tial condition is an optically-pumped coherent spin state 
along the x-axis, p(0) — \J) X (J\. 

Each term in Eq. @ has a physical implication for 
magnetometry. First, the Hamiltonian, H{B) = jBJy, 
generates the desired Larmor precession signal used to 
detect the magnetic field. The second term reflects mea- 
surement induced atomic decoherence that results from 
coupling the ensemble to the optical shotnoise on the 
probe laser. As a result the length of the Bloch vec- 
tor decays over time, J(t) = Jexp(— Mt/2), and M can 
be related to a bound on the transverse spin relaxation, 
T 2 < 2M" 1 . 

The significance of the third term in Eq. (0 is best 
seen after employing an approximation that holds for a 
large net magnetization and small field (ujjt <C 1). For 
an ensemble polarized along the x-axis, quantum fluctu- 
ations in J x are at least second order and the operator, 
J x , is well-approximated by the length of the Bloch vec- 
tor, J x — > J. Physically, this assumption capitalizes on 
the large value of J to treat the Bloch sphere as a locally 
flat phase space. This approximation is extremely good 
for both coherent and squeezed states with J 1. In a 
Gaussian approximation, the first and second moments 
of J z are sufficient to completely characterize the atomic 
state. Therefore, equations of motion for the mean and 
variance, 

d(J z ) c = -fBJe- Mt/2 dt + 2^/M^(AJ 2 )dW(t) (4) 
d(AJ z 2 ) = -AMn(AJ 2 ) 2 dt (5) 

provide a closed representation of the magnetometer's 
conditional quantum dynamics (in the uj^t <C 1 and 
t < limits). The physical significance of Eq. 

is that the atomic Bloch vector experiences two types 
of motion: deterministic Larmor precession and stochas- 
tic diffusion. Equation JSJ reflects the deterministic re- 
duction of (A J 2 ) as the atomic state is localized by the 
observation process, i.e., conditional spin-squeezing. 

Equations (J3J and © can be used to implement an 
optimal estimation procedure that capitalizes on squeez- 
ing without mistaking measurement-induced Bloch vec- 
tor rotations for true Larmor precession. Since the 
atomic dynamics are stochastic, the estimator must be 
described probabilistically — we desire a conditional prob- 
ability distribution, p (_B|S[ 0j t]), which measures the like- 
lihood that the field has magnitude B given the measure- 
ment record, 3, defined in terms of the photocurrent, 
dEt = y(t) dt/(2r)yM). The estimated magnitude, B, 
and its uncertainty, AB 2 are obtained from the moments, 

B = J Bp(B\E m ) dB (6) 
AB 2 = J(B-B) 2 p(B\~ [Q , t] ) dB (7) 
of the conditional distribution, p (_B|S[o )t ]J. 
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Constructing a maximum-likelihood estimator is ac- 
complished by defining an update rule that iteratively 
improves p (S|3r 0i {i) as the measurement record is ac- 
quired. Prior knowledge of the distribution of magnetic 
field values is encoded inp (£?|So), which may be assigned 
infinite variance in order to assure an unbiased estimate. 
Optimality requires that the conditional probability must 
be updated according to a Bayes' rule, 



with a and b given by, 



dp(B|dH t ,3[ 0>t )) = dq(dE t \B,^ [0 ^ t) )p(B\^ [0 . i 



(8) 



where dq(d3i : \B,'E,i 0;t \) is an infinitesimal conditional 
probability that describes the likelihood of the evolving 
measurement record, dEf, given a field with magnitude 
B and past history, 3[o,tV The utility of Bayes' rule is 
that q(dE t \B, S[o,t)) can De computed using quantum 
trajectory theory, Eqs. J3J| and 

Implementing this parameter estimator is best accom- 
plished by a (recursive) Kalman filter 0, El> 1X3 • It can 
be shown that the filtering equations, 

dx = A5cdt + D- 2 (B + VC T ){d~-Cidt) (9) 
with x = ( J z B) , (J z is the estimate of (J z ) c ), 
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D = l/(2y/Wfj), and x(0) = implement Eq. ©. We 
note that it is possible to extend the Kalman filter to 
account for time-varying or stochastic field s 1151 a s well 
as to implement quantum feedback control [lCl Il5| . 

The conditional quantum dynamics, particularly spin- 
squeezing and the exponential decay of the Bloch vector, 
enter the estimation process via the covariance matrix, 



V(t) 



AJ 2 (t) A(J z B)(t) 
A{BJ z ){t) AB 2 (t) 



(10) 



which describes the uncertainty in the parameter estima- 
tions of J z and B. Y(t) evolves deterministically accord- 
ing to the matrix Riccati equation, 



V = (A-D~ 2 BC)V + V 
+ D- 2 V(C T C) V 



A-D" 2 BC) (11) 



subject to the initial conditions AJ^(O) = and 
A(J z B)(0) = 0, with A£? 2 (0) chosen to reflect prior 
knowledge on the distribution of magnetic field values. 
Lacking any such knowledge, one can set AB 2 (0) — > oo. 

The smallest detectable magnetic field as a function of 
J and the measurement duration, t, is determined by the 
estimator variance, AB 2 . Solving the the matrix Riccati 
equation [which is analytically soluble for the Kalman 
filter in Eq. (JjJJ], provides the time-dependent magnetic 

field detection threshold, SB = J AB 2 (t), 



SB{t) 



(1 + 2<qJMt) 
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IrJy ae- Mt +4e- M */2(4? ? J+ 1) + b 



(12) 



a = -(2ryJ(Mi + 4) + l) 
b = Mt + 2r)J[Mt - 4) - 3 



Expanding Eq. I|12[) to leading order in t provides an 
expression for the detection threshold, 



SB(t) 
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that is directly comparable to Eq. JQ) when the measure- 
ment strength is chosen to be M ~ T 2 ~ 1 such that maxi- 
mal spin-squeezing is achieved at time t — M~ l . Such a 
choice for M permits a superior 1/J (equivalently 1/W) 
scaling that is characteristic of the Heisenberg squeezing 
limit 0, El • The optical shotnoise [of order unity in this 
model, see Eq. (|5J|] enters implicitly through the signal to 
noise ratio, SNR=J\/M, which highlights the utility of 
the Kalman filter as a whitening filter — it extracts the 
non-stationary spin-squeezing and Larmor precession dy- 
namics despite the presence of Gaussian noise. 

Figure [5] shows numerical results that demonstrate the 
performance of our quantum Kalman filter (QKF). The 
simulations were performed for an atomic ensemble with 
J = 4x 10 6 , 7 = 1 kHz/mG, r\ = I, and M = 100 kHz in 
a background magnetic field of B = 1 /j,G. These values 
nearly correspond to a magnetometer constructed from 
N = 10 6 ground state Cs atoms coupled to a high-finesse 
optical cavity with single photon Rabi frequency go = 
10 MHz and decay rate, k = 1 MHz. The QND mea- 
surement corresponds to a phase-quadrature homodyne 
detection of the transmitted cavity light with a cavity 
mode (P = 100 /xW) that is blue detuned by A = 1 
GHz from the Cs transition at A ~ 852 nm. The initial 
estimator variance was chosen to be Af? 2 (0) = 100 fiG 2 
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FIG. 2: Comparison of the estimation errors for a quantum 
Kalman filter and a linear least squares magnetic field de- 
termination. The inset plot highlights the 1/J (Heisenberg 
limited) scaling of both procedures for t ^> (JM)~ l . 
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which is the initial value that one would select given prior 
knowledge that the magnetic field could be treated as a 
Gaussian random variable with this variance. For the 
parameters we selected, Larmor precession and spin pro- 
jection noise have comparable magnitudes on timescales 
of order (JM) -1 . 

The Kalman estimation error (crosses in Fig. |2J) was 
computed from the ensemble average, E[(Bi — B) 2 ], for 
10 5 trajectories, and the solid line shows the estima- 
tion uncertainty AB(t) obtained by integrating Eq. Qlljl. 
Since our simulations were performed with B = 1 /iG, the 
empirical performance of the QKF closely matches the 
solid line. The dotted line in Fig. shows the analytic 
Riccati solution, given by Eq. JEJl, for A£? 2 (0) — > oo, 
which would be the expected QKF performance in a sce- 
nario with no prior knowledge of the magnetic field. Fig. 
12 also shows the estimation error for simple linear regres- 
sion of the measurement record (open circles) . Assuming 
that the Bloch vector has not decayed significantly, B 
is proportional to the slope of a line fit to the (filtered) 
photocurrent, y(t). The estimation error for linear re- 
gression was obtained by computing E[(Bi — B) 2 ] for 10 5 
trajectories. Although the QKF is clearly superior for 
short times, the two estimation procedures converge for 
(JM) -1 <C t < M~ l and provide a quantum parameter 
estimation with SB ~ 0.01 nG in t ~ 1 ms. The inset of 
Fig. HI highlights the SB oc J -1 scaling that distinguishes 
both the QKF (crosses) and regression (open circle) es- 
timators from the conventional shot-noise limit, Eq. ^ 
For sufficiently large times both estimators achieve the 
detection threshold in Ea. 1131 fsolid lines). 

The QKF and linear regression differ mainly in how 
they treat the initial diffusive transient of J z [Fig.^B)]. 
Since the QKF is derived from a quantum trajectory 
model, it is aware of the short-time diffusion and strate- 
gically under- weights the photocurrent at early times [via 
the Kalman gain, G = D- 2 (B + VC T )]. At late times 
the regression analysis manages to absorb the initial dif- 
fusive transient into the y-intercept of the linear fit. Al- 
though (J z (0)) = 0, the J z localization process gradually 
determines an effective offset in the photocurrent during 
the interval t ~ (JM) -1 . Without explicit knowledge 
of the conditional dynamics the linear regression equally 
weights the photocurrent for t < (JM) -1 . This decreases 
the quality of the fit, but the resulting error becomes in- 
significant for t ^> (JM) -1 . 

Our analysis suggests that estimation procedures 
based on conditional quantum dynamics can play a cru- 
cial role in optimizing both the sensitivity and the band- 
width in atomic magnetometry. While conventional 
steady-state magnetometers can only improve their de- 
tection capabilities by increasing the number of atoms or 
the averaging time, the quantum estimator can achieve 
greater precision for the same value of t and N by im- 
proving the measurement strength. The significance of 
the Kalman filter is the optimality that is guaranteed by 



its derivation from a Bayes' rule. Our finding that linear 
regression closely approximates the optimal procedure in- 
dicates a potentially simpler experimental procedure for 
sub-shotnoise magnetometry. Although Heisenberg lim- 
ited spin-squeezing should be possible using current tech- 
niques in cavity quantum electrodynamics (a discussion 
is provided in [Rj), the experimental difficulty of achiev- 
ing this limit makes it desirable to have an optimal es- 
timator such as the QKF to fully exploit even a small 
amount of squeezing, to treat fluctuating fields and to 
achieve estimator robustness (ljj . In either case, estima- 
tion procedures that allow and account for conditional 
quantum dynamics — whether explicitly as in the QKF 
or implicitly as in linear regression — offer substantial 
improvement over steady-state procedures. 
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